An Algorithm to Compute the Stochastically Stable Distribution of a Perturbed
نویسندگان
چکیده
of “An Algorithm to Compute the Stochastically Stable Distribution of a Perturbed Markov Matrix” by John R. Wicks, Ph.D., Brown University, May, 2009. Recently, some researchers have attempted to exploit state-aggregation techniques to compute stable distributions of high-dimensional Markov matrices (Gambin and Pokarowski, 2001). While these researchers have devised an efficient, recursive algorithm, their results are only approximate. We improve upon past results by presenting a novel state aggregation technique, which we use to give the first (to our knowledge) scalable, exact algorithm for computing the stochastically stable distribution of a perturbed Markov matrix. Since it is not combinatorial in nature, our algorithm is computationally feasible even for highdimensional models. An Algorithm to Compute the Stochastically Stable Distribution of a Perturbed Markov Matrix by John R. Wicks B. S., Mathematics/Computer Science and Economics, Carnegie Mellon University, 1983 M. S., Mathematics, Carnegie Mellon University, 1983 S. M., Mathematics, University of Chicago, 1983 Ph. D., Mathematics, University of Chicago, 1990 Sc. M., Computer Science, Brown University, 2007 Submitted in partial fulfillment of the requirements for the Degree of Doctor of Philosophy in the Department of Computer Science at Brown University Providence, Rhode Island May, 2009 c © Copyright 2009 by John R. Wicks This dissertation by John R. Wicks is accepted in its present form by the Department of Computer Science as satisfying the dissertation requirement for the degree of Doctor of Philosophy. Date Amy Greenwald, Director Recommended to the Graduate Council Date Ugur Cetintemel, Reader Date Roberto Serrano, Reader (Economics) Approved by the Graduate Council
منابع مشابه
An Algorithm to Compute the Stochastically Stable Distribution of a Perturbed Markov Matrix
of “An Algorithm to Compute the Stochastically Stable Distribution of a Perturbed Markov Matrix” by John R. Wicks, Ph.D., Brown University, August 2008. Recently, some researchers have attempted to exploit state-aggregation techniques to compute stable distributions of high-dimensional Markov matrices (Gambin and Pokarowski, 2001). While these researchers have devised an efficient, recursive al...
متن کاملAn Algorithm for Computing Stochastically Stable Distributions with Applications to Multiagent Learning in Repeated Games
One of the proposed solutions to the equilibrium selection problem for agents learning in repeated games is obtained via the notion of stochastic stability. Learning algorithms are perturbed so that the Markov chain underlying the learning dynamics is necessarily irreducible and yields a unique stable distribution. The stochastically stable distribution is the limit of these stable distribution...
متن کاملA Perturbed Half-normal Distribution and Its Applications
In this paper, a new generalization of the half-normal distribution which is called the perturbed half-normal distribution is introduced. The new distribution belongs to a family of distributions which includes the half-normal distribution along with an extra parameter to regulate skewness. The probability density function (pdf) is derived and some various properties of the new distribution are...
متن کاملA Quotient Construction on Markov Chains with Applications to the Theory of Generalized Simulated Annealing
In an earlier paper [14], we developed the first algorithm (to our knowledge) for computing the stochastically stable distribution of a perturbed Markov process. The primary tool was a novel quotient construction on Markov matrices. In this paper, we show that the ideas and techniques in that paper arise from a more fundamental construction on Markov chains, and have much wider applicability th...
متن کاملAn efficient numerical method for singularly perturbed second order ordinary differential equation
In this paper an exponentially fitted finite difference method is presented for solving singularly perturbed two-point boundary value problems with the boundary layer. A fitting factor is introduced and the model equation is discretized by a finite difference scheme on an uniform mesh. Thomas algorithm is used to solve the tri-diagonal system. The stability of the algorithm is investigated. It ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009